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TRIANGULAR DECOMPOSITION 
AS AN AID IN DETERMINING EIGENVALUES 
OF LARGE-ORDER BANDED SYMMETRIC MATRICES 


Edward F. Puccinelli 
Test and Evaluation Division 


SUMMARY 


In determining a subset of eigenvalues of the eigenspectrum of a real symmetric 
matrix one can not always be sure that all the eigenvalues in a certain region of 
the real axis he been found. 

This report describes how triangular decomposition, an essential step in many 
eigenvalue solution methods, can form a StUrm sequence. By forming two Stilrm 
sequences the number of eigenvalues in any region of the real axis can be 
determined. 

First, matrix decomposition is discussed followed by a description of how a 
symmetric matrix decomposition (i.e. a decomposition which preserves eigen- 
values) can always be made. Next it is shown how the diagonal terms of the U 
matrix in a symmetric LU decomposition form a Stilrm sequence and finally how 
this information can be used in conjunction with the determinant method of 
eigenvalue solution 
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TRIANGULAR DECOMPOSITION 
AS AN AID IN DETERMINING EIGENVALUES 
OF LARGE-ORDER BANDED SYMMETRIC MATRICES 


INTRODUCTION 

In finding a subset of the eigenvalues of real symmetric matrices, determining 
that all eigenvalues in a certain interval have been found is often a problem. 

The most obvious solution to this problem is to determine the complete eigen- 
spectrum. However, depending upon the order of the matrix, this approach may 
not be feasible economically. 

Another solution to the problem is use of the StUrm sequence method (Refer- 
ence 2, p. 245) for finding eigenvalues. This method determines one eigenvalue 
at a time and simultaneously reveals how many eigenvalues occur in a given 
interval. However, for large -order matrices, most of the computational work 
used by this method involves tri-diagonalizing the matrix. Tri-diagonalization 
requires about as many computations for a banded matrix as it does for a full 
matrix, so analysts frequently use methods which require fewer computationa 
for banded matrices. 

Examples of simpler methods are the determinant and the inverse power with 
shifts methods (Reference 3, Section 10). Both of these methods use triangular 
decomposition rather than tri-diagonalization. Dependent upon the number of 
eigenvalues sought and the order and bandwidth of the matrix, these two methods 
may prove faster because the triangular decomposition procedure takes advan- 
tage of the bandedness of the matrix. That is, fewer computations are required 
to decompose a banded matrix than to tri-diagonalize it. 

Although for banded matrices such procedures may prove to be less expensive 
computationally, these procedures do not include determination of the number of 
eigenvalues in any given interval of interest. 

This report shows how a little-known consequence of symmetric matrix decom- 
position can reveal the number of eigenvalues in any given region. The determi- 
nant method of eigenvalue solution included in this report may serve as a model 
for application to other single-extraction algorithms. 

The decomposition algorithm is a relatively simple tool for gathering information 
for finding the eigenvalues of a matrix. For matrices which are small enough to 
allow calculation by hand, triangular decomposition is an easy method not only of 
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determining the number of positive and negative eigenvalues of a matrix, but 
also of determining the multiplicity of an already known eigenvalue. 

In the rest of this report, all matrices referred to are assumed to be real and 
symmetric unless otherwise specified. 

TRIANGULAR DECOMPOSITION OF MATRICES 
Definition 

A lower triangular matrix is a square matrix C = (c t .) such that c. . s 0 for 
i < j. 

If Cj . = 0 for i > j then C is called upper triangular. 

If c u *= 1, c. . - 0 for i < j (for i > j) then C is lower (upper) unit triangular. 
Theorem 1 

Given a real symmetric matrix A of order n , none of whose principal minor 
matrices A k composed of the first k columns and rows (k = 1, 2, ...» n - l) has 
a zero determinant, a unique lower-unit triangular matrix L = (£ . . ) and a diago- 
nal matrix D = (d i .) exist such that LDL T = A. Moreover: 


det (A) = II d ii * 

i * 1 


Theorem 1 establishes the existence of the matrices L and D when A does not 
have any singular principal minors. Theorem 1 also reveals a simple means of 
finding the determinant of A. 

The elements of D and L are given by: 


d ; 


i i 
k* 1 


k 2d kk 


( 1 ) 


* 


Proof of tiiis theorem is in Reference 1, p. 27. 
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i > j 


(°) 


P 


1 1 




k- 1 


kk 



/d. 

' j j 


The d..'s are called pivots. The procedure described by Equations (1) and (2) is 
analogous to Gaussian elimination. If at some stage i, a d is equal to zero, 
Equation (2) cannot be computed. To solve this problem, interchange row i with 
some row t, (t > i), where a t . ^ 0. Such a row must exist because theorem 1 
ensures decomposability. 

ENSURING DECOMPOSABILITY WHILE PRESERVING EIGENVALUES 

The decomposition procedure breaks down when the A k principal minor has a 
zero determinant, because Equation (1) yields d kk = 0 and Equation (2) requires 
division by d . 

J kk 

Because the results included in the following sections apply to decomposable 
matrices, a useful tool would be a process which could alter the given matrix 
(while preserving its eigenvalues) and permit a decomposition. 

In decomposition procedures, interchanging the rows of a matrix when a zero 
pivot is encountered permits continuation of the decomposition procedure. How- 
ever, row interchanges alone generally alter the eigenvalues of the original 
matrix. 

Interchanging the corresponding two columns in addition to interchanging two 
rows is effectively a similarity transformation on the original matrix and, there- 
fore, does not change its eigenvalues. This method also preserves the symmetry 
of the original matrix, which is crucial in the proofs of the following sections. 

Theorem 2 

Given a real symmetrix matrix A of order n , at least one of whose principal 
minor matrices A k composed of the first k columns and rows (k = 1, 2, . . ., 
n- 1) has a zero determinant, a procedure exists for forming a similarity 
transformation of that matrix such that this similar matrix may be expressed as 
the product of a lower-unit triangular matrix L and an upper triangular matrix U. 

P£2Sf 

Let P, be an elementary matrix which interchanges rows (columns) t and j 
when A is multiplied on the left (right) by P. . . Then P i . AP^ is similar to A 
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and differs from A only in that rows i and j are interchanged and columns i 
and j are interchanged. 

Applying this proof to the decomposition procedure, when a zero pivot exists in 
position i, (dj 4 = 0), interchange columns and rows i and j, which puts a zero in 
position a . . Choose the number j , so that a. . is the last non-zero term on the 
diagonal of A. In general j = n, even if several similarity transformations must 
be made. 

However, a string of zeroes can occur in positions <i, i), (i + 1, i + 1), . ., 

(n, n) in the final D matrix. 

In this case the U = DL r matrix would have the form shown in Figure 1 at some 
stage of the decomposition. 

If this should occur, do not interchange rows and columns but use a different type 
of similarity transformation. A feasible type of similarity transformation to use 
would be the 45-degree plane rotation in the (i + 1, j) plane, where j is such that 
element (i + 1, j) / 0. 


11 u 1 2 


u . . . u 


u 22 ... u 2j 


u 1,i+1 u 1n 

U 2,i + 1 U 2n 

U i,i + 1 U i,n 

0 X X. . . X 

X 0 X. . . X 

X X 0. . . x 

X X X. . . o 


Figure 1. A Possible Decomposition Form 
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The transformation matrix would appear as: 



where 

a = /2 /2 

This would alter Figure 1 to be 



u li 

1 Y 
1 

Y 

U, + * 
1,1+3 

U 2i 

! Y 
1 

Y 

U 2, i+3 


Y 0 Y 
0 Y Y 

Y Y 0 


Y Y X 
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The (i + 1, i +1) pivot is now non- zero and the decomposition algorithm can 
proceed. If zero pivots occur again, reapply the similarity transformation logic 
already described (row-column interchanges first and then plane rotations, if 
necessary). Figure 2 is a simple flowchart of the procedure. 

Therefore, in determining the eigenvalues of a matrix, that particular matrix or 
a similar one is always decomposable. 


DETERMINING THE SIGNS OF EIGENVALUES 
Lemma 1 


Given an n x n real symmetrix matrix A which has a zero eigenvalue of multi- 
plicity m, if A is decomposable into the product of a lower-unit triangular 
matrix L and an upper triangular matrix U, the number of zeroes on the diagonal 
of U is m. 

Proof 

Because of its form L is non-singular, and therefore the rank of U is equal to 
the rank of A. By the hypothesis, the rank of A is n - m . Therefore, the rank of 
U is n - m, and the matrix U must have m zero eigenvalues . But the eigenvalues 
of U are simply its diagonal elements because of its form. Therefore U has m 
zero diagonal elements. 

Lemma 1 provides the means for determining the multiplicity of any known eigen- 
value \ of A, if the decomposition of A - Ki is possible. The previous section 
shows that such a decomposition (or at least an identical decomposition of a 
similar matrix) is always possible. 

Theorem 3 

If an n x n real symmetric matrix A is decomposable into the product of a lower 
triangular matrix L with unit diagonal and an upper triangular matrix U, the 
number of positive terms on the diagonal of U is equal to the number of eigen- 
values of A which are greater than zero. Furthermore, the number of zero 
terms on the diagonal of U is equal to the number of zero eigenvalues of A. 

(Note that this implies that the diagonal terms of the matrix U form a Sttlrm 
sequence.) 
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Figure 2. Decomposition Procedure Flow Chart 
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Proof 


The proof* follows by induction on the order of A. 

For n = 1, the theorem is trivially true. 

Assume the theorem is true for A k _ 1 where k - 1 = n, and let a l < a 2 < 
a k _ 1 be its eigenvalues. 

Let 



\-i 

i 

t 

1 

I 

1 

I 

i 

! 

CO 



1 

I 

]. 

a k-l,k 

I ! 

L 1 

i 

■ • • 

a k , k “ 1 j 

a kk 


and 


I 

1 

! u i.k 

i 

i 

1 

U k -1 1 • 

= 

1 

1 


J u k-l.k 


0 • ■ ■ 0 ] u kk 


Let < k 2 ^ , . . < \ k be the eigenvalues of A^. 


* 


The author developed this proof for another proof, see Reference 4. 
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By the bordering property (Reference 2, p. 244), \. < a. < \. + 1 for i = 1, 2, 
...» k - l. By assumption, the number of a. T s greater than zero is equal to the 
number of i , s greater than zero. 


Case 1 — Suppose p of the ct/s are greater than zero and none of the a.’s equal 
zero, as in Figure 3. The problem is to determine where \ k _ p+1 falls (is \ k _ p+1 
greater than, equal to, or less than zero). 


Vp-i “k-p 


H 


a W -p +2 


-I- 


\-p+l ? 


\-p*2 

-H — 


°k-2 <Vl 

H h- 

\-i \ 

— I h 


Figgre 3. Eigenspectra of A k and A k j 


By Lemma 1, if u kk = 0 then ^ k - p+1 = 0. Suppose u kk > 0. Since det (U k ) = 
det (U k .j) x u kk , then sign det (U k ) = sign det (U kM ). Now 


k-l 

det(U k _i) = II a , 
i = l 


k 

d et(U k ) = n»i 

i “ 1 


Because the signs are the same, \- p+l must be greater than zero. Similarly, 
if u kk is less than zero, the signs must be opposite; hence, \_ p+1 must be less 
than zero. 

Case 2 — Suppose p of the a. ’s are greater than zero and r of the a i 's equal 
zero (r = 1, . . n - p). If u kk = 0, then by Lemma 1, \ k _ p+1 = 0. 


9 



Suppose u kk ^ 0,then 


U, 




>P 


j 


•\ 


Vk- 


1 - P “ r 


r r 


+^ — 
u kk 


with u kk > 0 or u kk < 0. 

Note that the terms on the diagonal of U k _ x can be arranged as in Figure 3 by 
similarity transformations on \ which interchange appropriate rows and 
columns. U k may not be upper triangular (nor will 1^ be lower triangular), but 
the characteristic that det (A. ) = det (Uj) is preserved because matrices P used 
for interchanging rows and columns have a determinant of minus 1. 

Next, interchange one more row and column so that u kk is in position (k - r, k - r) 
and the zero which was in that position goes to position (k,k). Hence: 

K = PA t F = (PkP)(Pu k P) = i^u; 
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where U,’ 

k 


+ 

+ 


> P 




rk - 1 - p - r 


0 

0 


0 


■+ row k ~ r 


>r 


Because similarity transformations were made only on A k , A k has the same 
eigenvalues. Consider the principal minors A' k _ r and A L- r -i of A^, composed 
of the first k - r and k - r - 1 rows and columns of A k . 


det A 'k-r-l = U k-,-l 

det A' k _ t = det = det U^_ r _, » u kk 


hence: 


det A k-r ~ det A k-r-l x u kk 


Let / 3 . be the eigenvalues of A' k _ r _ t and y. be the eigenvalues of A' k _ r . Then; 
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k-r k“ r - 1 

IT ?■, = IT 4 ■ u, 

i * 1 i » 1 


The bordering property shows that: 

7i 1 A 1 r i + i i = k-r-1 


Hence, at least as many negative (positive) eigenvalues exist in A' k _ r as the num- 
ber of negative (positive) eigenvalues existing in A' k _ f _ r If u kk is greater (less) 
than zero, the extra eigenvalue of A' k-r is also greater (less) than zero. 

Let (k_r “ j ) be the eigenvalues of A' k _ r - . . In particular, 


C.<k) = 

3 1 1 

^.(k-.-D = /?. 


Consider A' k _ r + 1 . The U' k _ r+1 matrix shows* that the addition of the row and 
column to A' k _ f which forms A' k _ r+1 introduces a zero eigenvalue to the eigen- 
spectrum of A' . By the separation theorem, as many positive and negative 
eigenvalues still exist in A' k _ as the number existing in the A' k _ r matrix. 

That is, the number of £.( k “ r+ i) > 0 (< 0) is equal to the number of £ i < k " r > > 0 
(< 0). The logic is the same for each row and column added until the original 
is formed. 

Figure 4 is a pictorial description of this phenomenon where e is positive or 
negative depending on the sign of u kk . Hence, by lemma 1, A k has r zero eigen- 
values and by the above argument, if u kk > 0, then A k has p + 1 positive eigen- 
values. If u kk < 0, then A k has k - p - r negative eigenvalues. 


*By lemma 1 
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0 


— £«■-'-•> = 3 

— £, (k ‘ ,) r y, 
f- £,< k -'*» 


Figure 4. Eigenspectro of Principal Minors 


This theorem provides a simple means of determining the number of eigenvalues 
of the matrix A in any interval [a , b] of the real axis. First, translate the 
eigenspectrum of A, using a and b as shift values. Then decompose the two 
matrices A - al and A - bl (or similar matrices) into the product of triangular 
matrices L a U a and L b U b respectively. As indicated in theorem 2, observe the 
signs of the terms on the diagonal of U a and then of U b to determine how many 
eigenvalues occur in (a,b). For instance, if U a has r positive terms on its 
diagonal and U b has s positive terms on its diagonal, then | r - s| eigenvalues 
exist in (a, b). The number of zeroes on the diagonal of U a indicate the number 
of eigenvalues at point a, and the number of zeroes on the diagonal of U b indi- 
cate the number of eigenvalues at point b . 

For example, consider the matrix 


5 


2 4 


7 


A = 


2 

4 


1 3 8 

3 8 5 


7 


8 5 3 


To determine the number of eigenvalues between -2 and +4, decompose the fol- 
lowing: 


A + 21 = 


7 2 

2 3 

4 3 

7 8 


4 7 

3 8 

10 5 

5 5 
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Its U matrix is- 


U-2 


7 2 4 7 

0 17/7 13/7 6 

0 0 107/17 -61/17 


0 0 


0 


-15,712 

1819 


Next decompose: 


12 4 7 


A - 41 = 


2 

4 

7 


3 


3 

8 


3 8 


4 

5 



Its U matrix is: 


U 


4 


12 4 

0 -7 -5 

0 0 -59/7 

0 0 0 


7 

-6 

-131/7 

-1365/413 


U_ 2 has three positive diagonal terms, and U 4 has one positive diagonal term 
indicating two eigenvalues in (-2, 4). Because no zeroes appear on the diagonal 
of either U matrix, only two eigenvalues occur in [-2, 4]. 

The eigenvalues of A , to two decimal places, are: 


-7.10 -2 

1.36 

3.56 +4 

19.18 
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If a zero had occurred on the diagonal of U a or U b * -2 or +4 would had to have 
been an eigenvalue. 

DETERMINANT METHOD OF EIGENVALUE SOLUTION 

The determinant method of eigenvalue solution is based on the concept of finding 
the roots of the characteristic polynomial of a given matrix. The characteristic 
polynomial of A may be expressed as: 


det (A - XI) = (X - X^ (X - X 2 ) . . . (X - X n ), 


where X lt X 2 , . . X n are the eigenvalues of A. 

To determine an eigenvalue, evaluate the determinant of A - X I for various 
values of X . The value which yields a zero value for the determinant must be an 
eigenvalue. 

The most practical method for evaluating the determinant of a matrix is to use 
the result of the decomposition theorem (make the triangular decomposition A = 
LDL t - LU). The determinant of A is simply the product of the diagonal terms 
of U. 

Several polynomial curve fitting schemes exist for tracking the roots of a deter- 
minant. Wilkinson 5 shows that little is to be gained by using polynomials higher 
than the second degree. 

The following is Muller’s quadratic method from Wilkinson’s text (p. 435). 

Choose three points (p k _ 2 . f(p k _ 2 >), (p k _ lt f (p kM )) , and (p k , ffc^)) on the 
characteristic polynomial f (X) = det (A - XI). Interpolate these three points 
and determine the zeroes of the resulting quadratic equation. Use the zero 
closest to p k as a p k+1 , and repeat the process until a satisfactory zero of the 
characteristic polynomial is computed (Figure 5). 

A fault in this method appears when A has some very close or multiple roots. 

The following graph (Figure 6) of the characteristic equation of such a matrix 
shows such a fault. If p k _ 2 , p k _ x , and p k are as shown in the graph, the process 
converges to X 3 rather than X $ . 

In calculating the determinants of A - (p k _ 2 )I, A - (p kM )I, and A - (p k )I by 
using triangular decomposition as described in theorem 2, the results of 
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theorem 3 reveals how many positive, negative, and zero eigenvalues each of 
the matrices have. Taking the difference of the answers shows exactly how many 
eigenvalues occur between the points p k _ 2 * p^.p and P k * An example of how 
this information may be useful is given in the problem described by Figure 6 
where instead of the procedure predicting p k + j on the right of p k , a modified 
algorithm can force p k + 1 to be between p k _, and p k . 

However, the search logic does not need extra tests at this stage. Suppose in a 
search for all of the eigenvalues in region ( a, b] , the characteristic equation 
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f(\) = n (\ - \. ) g(,v) (where i is such that a < X. < b) looks like Figure 7. 



Figure 7. Characteristic Polynomial Over interval [a, b] 


Suppose the search logic proceeds from left to right beginning at point a and 
sweeping out eigenvalues as it proceeds. If the method ran to completion and 
found all the eigenvalues, the resulting graph might appear as Figure 8. 



Figure 8. Defloted Polynomial g(A) When All Eigenvalues in [ a, b ] Have Been Found 

However, if some eigenvalues had been missed, the curve of the deflated poly 
nomial g(\) might appear as Figure 9. 
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Figure 9. Deflated Polynomial g(A.) When Two Eigenvalues in [a, b] Were Missed 


In any event, the decomposition of A - a I and A - bl determines the number of 
eigenvalues between a and b. If that number equals the number found, then all 
the eigenvalues have been found. If the number is not equal to the number found, 
then some of the eigenvalues have not been found. If the number of negative 
eigenvalues for each of the decompositions of A - p k I was recorded, the record 
could be searched to determine approximately where the missing roots occur. 

Figure 10 is a flow chart of the proposed method for ensuring that all eigenvalues 
in an interval have been found. 


CONCLUSIONS 

Therefore, by theorem 3, the exact number of eigenvalues that fall within a given 
interval of interest can be determined without using the Stitrm sequence method. 
Hence solution methods more efficient than the Sttirm sequence method can be 
used without the risk of missing some eigenvalues in a certain range. Informa- 
tion about the eigenvalues of a matrix may already be present in a solution method 
which uses triangular decomposition, hi this case only a few alterations to the 
method are necessary to ensure that all eigenvalues are found in a given range. 


18 



APPLY SOLUTION METHOD TO 
DETERMINE THE EIGENVALUES 
IN [a, b ] 



Figure 10. Flow Chart of Proposed Method for Ensuring That 
All Eigenvalues in an Interval Have Been Found 
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